Homeomorphic smoothing splines: a new tool for monotonizing an unconstrained estimator in nonparametric regression
نویسنده
چکیده
In this paper we focus on nonparametric estimation of a monotone regression function using general spline smoothing techniques. We propose to construct a new class of monotone splines by using some tools that have been recently developed in the context of image warping to compute smooth and bijective deformations. Our idea is to adapt these tools to construct a monotone spline that can be used to monotonize any unconstrained estimator of a regression function. We show that under mild conditions, this monotone smoother inherits the convergence properties of the unconstrained estimator. Our estimator is defined as the solution of an ordinary differential equation governed by an appropriate time-dependent vector field depending on the unconstrained estimate. Unlike some classical spline smoothing techniques under shape constraints, our method does not require the use of quadratic programming techniques under linear constraints and has therefore a low computational cost. We illustrate its finite sample performance via a simulation study, and we also compare it with a recently proposed constrained estimator. An illustration to some real data is given.
منابع مشابه
NONPARAMETRIC KERNEL REGRESSION SUBJECT TO MONOTONICITY CONSTRAINTS By Peter Hall and Li-Shan Huang Australian National University and CSIRO and Australian National University
We suggest a method for monotonizing general kernel-type estimators, for example local linear estimators and Nadaraya–Watson estimators. Attributes of our approach include the fact that it produces smooth estimates, indeed with the same smoothness as the unconstrained estimate. The method is applicable to a particularly wide range of estimator types, it can be trivially modified to render an es...
متن کاملSmoothing under Diffeomorphic Constraints with Homeomorphic Splines
In this paper we introduce a new class of diffeomorphic smoothers based on general spline smoothing techniques and on the use of some tools that have been recently developed in the context of image warping to compute smooth diffeomorphisms. This diffeomorphic spline is defined as the solution of an ordinary differential equation governed by an appropriate time-dependent vector field. This solut...
متن کاملUniform error bounds for smoothing splines
Almost sure bounds are established on the uniform error of smoothing spline estimators in nonparametric regression with random designs. Some results of Einmahl and Mason (2005) are used to derive uniform error bounds for the approximation of the spline smoother by an “equivalent” reproducing kernel regression estimator, as well as for proving uniform error bounds on the reproducing kernel regre...
متن کاملEquivalent kernels of smoothing splines in nonparametric regression for clustered/longitudinal data
S For independent data, it is well known that kernel methods and spline methods are essentially asymptotically equivalent (Silverman, 1984). However, recent work of Welsh et al. (2002) shows that the same is not true for clustered/longitudinal data. Splines and conventional kernels are different in localness and ability to account for the within-cluster correlation. We show that a smoothi...
متن کاملBayesian mixture of splines for spatially adaptive nonparametric regression
A Bayesian approach is presented for spatially adaptive nonparametric regression where the regression function is modelled as a mixture of splines. Each component spline in the mixture has associated with it a smoothing parameter which is defined over a local region of the covariate space. These local regions overlap such that individual data points may lie simultaneously in multiple regions. C...
متن کامل